Testing Composite Hypotheses via Convex Duality 



Birgit Rudloff t and Ioannis Karatzas 



i 



September 5, 2008 



Abstract 



We study the problem of testing composite hypotheses versus composite alter- 
natives, using a convex duality approach. In contrast to classical results obtained 
by Krafft & Witting where sufficient optimality conditions are obtained via 
Lagrange duality, we obtain necessary and sufficient optimality conditions via 
Fenchel duality under some compactness assumptions. This approach also dif- 
fers from the methodology developed in Cvitanic & Karatzas [6j. 
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1 Introduction 

The problem of Hypothesis Testing is well understood in the classical case of testing 
a simple hypothesis versus a simple alternative. Suppose one wants to discriminate 
between two probability measures P (the "null hypothesis") and Q (the "alternative 
hypothesis"). In the classical Neyman-Pearson formulation, one seeks a randomized 
test (p : Q — > [0, 1] which is optimal, in that it minimizes the overall probability 
E^(l — ip) of not rejecting P when this hypothesis is false, while keeping below a given 
significance level a G (0, 1) the overall probability E p (</)) of rejecting the hypothesis 
P when in fact it is true. 

In this classical framework an optimal randomized test <p always exists and can 
be calculated explicitly in terms of a reference probability measure R, with respect to 
which both measures are absolutely continuous (for instance, R = (P + Q)/2). It has 
the randomized 0-1 structure 



*Work supported in part by the National Science Foundation under Grant NSF-DMS-06-01774. 

T Princeton University, Department of Operations Research and Financial Engineering, Princeton, 
NJ 08544, USA. E-mail: brudloff@princeton.edu 

^Columbia University, Department of Mathematics, MailCode 4438, New York, NY 10027, USA. 
E-mail: ik@math.columbia.edu 



V = 1 {L>i} + S ■ l {L=i\ 




that involves the likelihood ratio L = (dQ / dR) / (dP / dR) of the densities of the null 
and the alternative hypotheses, the quantile 3 = in{{z > : P(L > z) < a} , and the 
number 5 G [0, 1] which enforces the significance-level requirement without slackness, 
that is, E p (<£>) = a . 

The problem becomes considerably more involved when the hypotheses are com- 
posite, that is, when one has to discriminate between two entire families of probability 
measures; then likelihood ratios of mixed strategies have to be considered. This type 
of problem also arises in the financial mathematics context of minimizing the expected 
hedging loss in incomplete or constrained markets; see e.g. Cvitanic |5j, Schied [16] 
and Rudloff [15J. It was shown by Lehmann p2], Krafft & Witting Baumann 
[I], Huber & Strassen [TO], Osterreicher [TJ], Witting [18], Vajda [17J and Cvitanic & 
Karatzas [BJ, that duality plays a crucial role in solving the testing problem. Most 
of these papers deal with Lagrange duality; they prove that the typical 0-1 structure 
of (OQ) is sufficient for optimality, and that it is both necessary and sufficient if a dual 
solution exists. An important question then is to decide when a dual solution will exist, 
and to describe it when it does. 

The most recent of these papers, Cvitanic & Karatzas [B], takes a different duality 
approach. Methods from non-smooth convex analysis are employed, and the set of 
densities in the null hypothesis is enlarged, in order to obtain the existence of a dual 
solution - which plays again a crucial role. 

In the present paper we shall use Fenchel duality. One advantage of this approach 
is that, as soon as one can prove the validity of strong duality, the existence of a dual 
solution follows. We shall show that strong duality holds under certain compactness 
assumptions. This generalizes previous results, insofar as no need to enlarge the set of 
densities arises, a dual solution is obtained, and thus necessary and sufficient conditions 
for optimality ensue. 

In Section 2 we introduce the problem of testing composite hypotheses. Section 3 
gives an overview of the duality results, which are established and explained in detail in 
Section 4. In Section 5 the imposed assumptions are discussed and possible extensions 
are given. A comparison of the results and methods of this paper, with those in the 
extant literature, can be found in the last sections, including Section 6. 

2 Testing of Composite Hypotheses 

Let (Q, J 7 ) be a measurable space. A central problem in the theory of Hypothesis 
Testing is to discriminate between a given family V of probability measures (composite 
"null hypothesis") and another given family Q of probability measures (composite 
"alternative hypothesis"). 

Suppose that there exists a reference probability measure R on (fi,jF), that is, a 
probability measure with respect to which all probability measures P EV and Q G Q 
are absolutely continuous. We shall use the notation Zjj = dU/dR for the Radon- 
Nikodym derivative of a finite measure II which is absolutely continuous with respect 
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to the reference measure, and E n (Y) := J n YdTl = J n Z n YdR for the integral with 
respect to such II of an T— measurable function Y : Q — > [0, oo). Finally, we shall 
denote the sets of these Radon-Nikodym derivatives for the composite null hypothesis 
and for the composite alternative hypothesis, respectively, by 

3 V :={Z P \PeV} and 3 S := {Z Q \ Q G Q} . 

Both 3p and 3q are subsets of the non-negative cone h\ and of the unit ball in 
the Banach space L 1 = L 1 (fi, J 7 , R). We shall assume that the mapping 11 x 3p 9 
(a;, Z) i — ► Z{u) G [0, oo) is measurable with respect to the product a— algebra jF(g)£> , 
where B is the a— algebra of Borel subsets of 3^- 

We shall denote by $ the set of all randomized tests, i.e., of all Borel- measurable 
functions <p : Q — > [0,1] on (fi,jF). The interpretation is as follows: if the outcome 
uj G Q is observed and the randomized test tp is used, then the null hypothesis V is 
rejected with probability <p(u>). Thus, E p [y] = f n (p(uj)P(duj) is the overall probability 
of type-I-error (of rejecting the null hypothesis, when in fact it is true) under a scenario 
P G V ; whereas E^[l — ip] is the overall probability of type-II-error (of not rejecting 
the null hypothesis, when in fact it is false) under the scenario Q G Q . 

We shall adopt the Neyman- Pearson point of view, whereby a type-I-error is viewed 
as the more severe one and is not allowed to occur with probability that exceeds a 
given acceptable significance level a G (0, 1), no matter which scenario P G V might 
materialize. Among all randomized tests that observe this constraint 

s((p) := sup E p [<p] < a, (2) 
Per 

we then try to minimize the highest probability supg g g (l — E^ [<£>]) of type-II-error 
over all scenarios in the alternative hypothesis. We look in other words for a randomized 
test <p that maximizes the smallest power with respect to all alternative scenarios 

ir(<p):= inf E Q U , 
QeQ 

over all randomized tests <p whose 'size' s(ip), the quantity defined in (j2J), does not 
exceed a given significance level a. 

Equivalently, we look for a randomized test <p G $ that attains the supremum 

V_ := sup n((p) = sup I inf E Q [y?] 

of the power ir(<p) , over all generalized tests in the class 

supE p [<^]<a}. (4) 
PeV > 

When such a randomized test (p exists, it will be called (max-min) optimal. 
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3 Duality 



We shall denote by A + the set of finite measures on the measurable space (3-p, B) ■ We 
shall then associate to the maximization problem of ([3]) the dual minimization problem 



V* 



inf V{Q,X), 

AgA , 



where 



V{Q,X) :=E R 



Zp dX 



+ c*A(3p). 



(5) 



(6) 



Here and in the sequel, we view Zp(u)dX as the integral with respect to the 
measure A of the continuous functional 3p 3 Z i — > £(Z;u) := Z{uS) G H, for fixed 
wgO; see (1191) below for an amplification of this point. 

The idea behind the setting of ([5]), ([6]) is simple: we regard A as a 'Bayesian prior' 
distribution on the set 3p of densities for the null hypothesis, and its total mass 
A(3p) < oo as a variable whose role is to enforce the constraint in More precisely: 
for any given Q G Q and any (p G $q, , we have by Tonelli's theorem the weak duality 



(7) 
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< E 



R 



J Q 



Zp dX 



3p 



+ aX(3v) = V(Q,X), 



for all A G A_ 
both 

and 

It follows from ( 
and Q G Q , so 



Now let us observe that equality holds in ([7]), if and only if we have 



z qW) > $i v Z p{w)dX 
z q{u) < f 5v Z P (u)dX 



for R — a.e. u£0 



E [ipZp ] = a , for A - a.e. Zp G 3p • (9) 
that the inequality sup ¥ , g$c E Q [ip] < V(Q, A) holds for all A G A+ 



V < V 



inf sup E Q \tp] 



< V* 



(10) 



in the notation of ©, 

The challenge, then, it to turn this 'weak' duality into 'strong'. That is, to show 
that equalities V_ = V = V* prevail in (1101) : that the infimum in §5§ is attained by 
some (Q,X) G Q x A + ; that there exists a tp G $ a for which the triple (<p,Q,X) 
satisfies (jHj), @; that for this triple equality prevails in (J7|); and that this same <p is 
optimal for the generalized hypothesis-testing problem, i.e., attains the supremum in 

(ED. 
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4 Results 

In order to carry out the program outlined in the previous section, we shall impose the 
following assumptions. A discussion of their role can be found in Remark 15.11 

Assumption 4.1. 

(i) 3q is a weakly compact, convex subset of L 1 . 

(ii) "iv is a compact subset of L 1 . 
Our main result reads as follows. 

Theorem 4.2 (Generalized Neyman- Pearson Lemma). Let V, Q be families of prob- 
ability measures on (flyJ 7 ) as in Sections^ andlE, that satisfy Assumption ^ -1\ For a 
given constant a G (0, 1), recall the subclass $ a of randomized tests in (H). 

There exists then a randomized test tp G <& a which is optimal for, that is, attains 
the supremum in, (TJJ). There exists also a solution to the dual problem of ([3]], to wit, 
a pair (Q, A) G Q x A + which attains the infimum there. 

Furthermore, strong duality is satisfied, in the sense that 

• the optimal test for |3|) has the structure of $E$, (TJJ), namely 

f 1 = Zq{u)> j^Z P {u)d\ \ 
{ : Zq(lu) < Z p (oj) dX J 

and 

~E R [<pZp] = a , for X — a.e. Zp G 3-p ; whereas (12) 

• (<£>, Q) is a saddle point in $ a x Q of the functional (ip, Q) \— > E®[<p\ : 

E^[cp) < E«[£] < E Q [^], V (<p,Q)E ixQ. (13) 



We shall prove the theorem in several steps, using the following lemmata. The 
convention of denoting by "max" (resp., "min") a supremum (resp., infimum) which is 
attained, will be used freely. 

Lemma 4.3. The supremum in (TJ|) is attained by some randomized test p> G $ Q ; and 
there exists a Q G Q such that the saddle-point property (TJ3)) holds. In particular, the 
lower- and upper-values V_ and V of (Ej] and flU) . respectively, are the same, i.e., 



max 



I minE Q M ) = min ( maxE Q M ) . (14) 
\QeQ 7 QeQ \</>e* a J 
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Proof. The set $ of all randomized tests is a weakly* compact subset of the Banach 
space L°° = L°°(f2, T, R) , as it is a weakly* closed subset of the weakly* compact 
unit ball in L°° (Alaoglu's theorem, e.g. Dunford & Schwartz [7j, Theorem V.4.2 and 
Corollary V.4.3). 

To see that $ is weakly* closed, consider a net {(p a }atD ^ $ that converges 
to (p with respect to the weak* topology in L°°. This means that for all X £ L 1 
we have E^f^X] — > K R [(pX]. If there existed an event Qi £ JF with R(Qi) > and 
{ip > 1} C fi x , then we could choose X(c<j) = l^cu) £ L 1 and obtain E^f^X] > R(Qx). 
But this contradicts E^yjX] = lim a E [<^q,X] < R(Qi), which follows from ip Q < 1 for 
all a £ D, since <^ a £ Hence, < 1 holds R—a.e. It can be shown similarly that 
if > also holds i2— a.e. 

Thus $ is indeed weakly* closed, hence weakly* compact. Since the mapping 
if I— > sup Pe -p E p [(/)] is lower-semi continuous in the weak* topology, the set $ a in (jl]) 
is weakly* closed, hence weakly* compact. Because of the upper-semi continuity of the 
mapping ip f— > 7r(<yj) = infggg E Q [<£>] in the weak* topology, there exists a cp £ $ a that 
attains the supremum in ([3]). 

The weak* compactness and convexity of $ a , and the weak compactness and con- 
vexity of 3q (Assumption I4.1( i)). enable us to apply the von Neumann min-max the- 
orem (see e.g. Aubin [2], Theorem 7, Chapter 7.1, or Aubin [3], section 2.7, pages 
39-45); the assertions follow. □ 

Let us fix now an arbitrary Q £ Q , and consider as our primal problem the inner 
maximization in the middle term of ( Tl~0|) . namely: 

p(Q) := supE Q M. (15) 

This supremum is always attained, since $ a is weakly* compact. We want to show 
that strong duality holds between ( TT51) and its Fenchel dual problem which, we claim, 
is of the form 



D(Q) = inf V(Q,X) = inf 

AeA + AeA + 



J (Zq-J Zpd\y dR + a A(3t>) 



3-p 



(16) 



In this case, the typical 0-1 structure of the randomized test ifQ £ $ a that attains 
the supremum in ( fl5l) . is necessary and sufficient for optimality. 



Lemma 4.4. Strong duality holds for problems (Tb\) and (Thy , that is, 

V Q £ Q : D(Q) = p(Q). 

Moreover, for each Q £ Q ; i/iere exists an element Xq of A + which attains the infi- 
mum in /[Tb)) ; whereas an optimal randomized test <pq £ $ Q that attains the supremum 
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in < f73|) has the structure of (TJ]) and (Tj|) ; namely 

( 1 : Z Q {u)>J 3p Z P {Lj)dX Q } 
<Pq(uj) — < _ > , /or i? — a.e. wGH (17) 

[ : Z Q (u;)< ^ZpHcZAq J 

and 

E R [ $ Q Z P ] = a , /or A Q - a.e. Z P G3 P . (18) 

Proof. Let £ be the linear space of all continuous functionals £ : 3p —* 1R on the 
compact subset 3p of L 1 (Assumption 14. 1 ( ii) ) with pointwise addition, multiplication 
by real numbers, and pointwise partial order 

e 1 < £ 2 <^ l 2 - £i e £+:={£ e £ \ £(Z P ) > 0, VP e V] . 

We endow £ with the supremum norm \\£\\c = sup PeP |^(Zp)| , which ensures that £ 
is a Banach space (Dunford & Schwartz [7], Section IV. 6). 

Similarly, we let A be the space of finite signed measures A = A + — A~ on (3-p, B) , 
with A ± G A + . We regard this space as the norm-dual of £ , with the bilinear form 

(£,X) = [ £d\ for £e£, AgA; (19) 

see Aliprantis & Border pQ, Corollary 14.15. (Intuitively speaking, the elements of 
A are generalized Bayesian priors, that may assign negative mass to certain null hy- 
potheses; they are countably additive, however.) We have also the clear identification 
A+ = {A G A | X(B) > 0, V-B G £>} . 

Let us define a linear operator A : (L°°, || ■ ||l°o) — > (£, \\ ■ \\c) by 

L.°° 3 (p i — > (A<p)(Z P ) := -E p [ip] = -E R [ipZ P } G R, (20) 

for Zp G 3-p; this operator is bounded, thus continuous. We introduce also the constant 
functionals 1,0 G £ by 

V Z P G 3p : 1(Z P ) = 1 G H , 0(Z P ) = G IR . 
The constraint of (j2J) can be rewritten then as 

al + Av9>0 A</?G£+-al. 
With this notation, for any given Q G Q the primal problem (I15p can be cast as 

-p(-Q) = inf (E Q [( P ]+l^(<p)+X c+ . oil (A<p)) (21) 
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where — Q is interpreted as a finite, signed measure on (ft, J 7 ) ; cf. the discussion 
preceding (J2HJ) • Here and for the remainder of this proof, we use the notation T c [}f) := 
for ip G C , Xc(v?) := oo for ip ^ C , as well as 

f(<p) := E Q M , g(A<p) := J £+ _ al (^) . (22) 



• We claim that the Fenchel dual of the primal problem in (1151) has the form (jl6l) . We 
shall begin the proof of this claim by recalling (from Ekeland & Temam [8], Proposi- 
tion III. 1.1, Theorem III. 4.1 and Remark III. 4. 2) that the Fenchel dual of the problem 
( |2ll is given by 

- 3(-Q) = sup ( - f*(A*X) - g*(—X)) , (23) 
AeA 

where A* : A — > ba(fi, JF, i?) the adjoint of the operator A in f)20p . Here and in 
the sequel, ba(Q, J 7 , R) is the space of bounded, (finitely-) additive set-functions on 
(Q, J 7 ) which are absolutely continuous with respect to R (see, for instance, Yosida 
[T9] . Chapter IV, section 9, Example 5). 

The function g*(-) is the conjugate of the function g(-), namely 

g*(X) = su P ((I,X)-l c+ -ai(I)) = sup (lX) = sup(£-al,A> 
eec eec+~ai 



sup (£, A) — a / dX = Zc* (A) — a A(3-p) 



3t> 



where := {A G A | (£, A) < , V£ G C + } is the negative dual cone of C + . The last 
equality in the above string holds, because £+ is a cone containing the origin G C . 

To determine the conjugate /*(•) of the function /(•) at A* A, namely 
f*(A*X) = sup \(A*X,if)-E Q [ip]~l^)\, 

we have to calculate (A*X, <p). By the definition of A*, the equation (A*X, (p) = (A, A<p) 
has to be satisfied for all (p G L°°, A G A (see pj, Chapter 6.8). Thus, 

V^GL°°, VAgA: (A*X, <p) = - J E R [(fZ P ) dX , 

and the conjugate of the function /(■) at A* X is evaluated as 

f*(A*X) = sup (- f E R [ipZ P ]dX-E Q [<f 
3v 
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The dual problem (1231) becomes therefore 

sup(-y E R [tpZp]dX — E Q [p]j - l-c* + {\) -a\($p) 

E R [(pZ P ]dX-E% 



-Q(-Q) = sup 

AGA 



?yp 



sup 

Xe-ci 



sup 



It is not hard to show that — £*_ = A . , so 



aA(3 



can be re-cast in the form 



(24) 



D(— Q) = sup 


sup j - / 


AeA + 


^e* \ J 




1 v 3p 



J E R [Z P <p\ dX - E R [Z Q (p]j - a A(3t>) 



(25) 



• Now both (fl, J 7 , R) and (3p,B, A) for A G A + are positive, finite measure spaces. 
Furthermore, for every p G $ the mapping fl x 3i> 9 (tu, Zp) i — > f(u,Zp) := 
Zp{oj)ip{uj) G 1R is measurable with respect to the product a— algebra T ' ®E , thanks 
to the measurability assumption imposed in Section [2j whereas for every A G A + and 
p> G $ we have 



\Zp tp\ dRdX < ( sup \\Z P \\ fi ) A(3p) = A (3-p) < oo 




3r n 



since IMIl,^ < 1 • Thus, we can apply Tonelli's Theorem (see [7j, Corollary III. 11. 15) 
and deduce that the order of integration can be interchanged, i.e., for all A G A + and 
all ip G $ we have 




ZpipdRdX = J J ZpipdXdR < oo . 
3-p n n 3-p 

In (12 5 p only elements A G A + and ip € <& are considered, so we can interchange the 
order of integration and obtain 

-3(-Q) = sup (-sup E fi L(-Z Q - / ZprfA)! -«A(3p)) • (26) 
AeA+ v we* L v J ' J ' 



3p 



Since <^ G $ is a randomized test, it follows that the supremum over all p> G $ in (T26 
is attained by some Tp x _q g $ of a form similar to jS}, namely 



1 : -Z g (w) > 4, dA 
: -Z Q {u)< ^ p Z P (u)dX 



, for i? - a.e. u e Q . (27) 
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Given any finite, signed measure II = II + — II on (Q, JF) with II ± -C R , let us 
denote Z n = Z u + — Z n - and 



T Aj n := Z u - [ ZpdX G L 1 



,28) 

and let Y^~ n (respectively, T^ n ) be the positive (respectively, negative) part of the 
random variable in fl28|) . With this notation, and recalling (J27J), the value of the dual 
problem f)26p becomes 

-V{-Q) = sup {-E R [TX_ Q ]-aXOv)}, 
AeA+ 

thus 

= inf (E R [T+ Q ]+aA(3p)}. (29) 

AG A-f- 

We deduce from this representation and ( 1281) that the dual 0(<5), of the primal problem 
p(Q) of ( TT5j) . is indeed as claimed in equation ( fi~6i) . 

• Now strong duality holds if both /(■) and <?(•) are convex; if g(-) is continuous at some 
Aip with ifQ G dom(/); and if p(Q) is finite (see Ekeland & Temam [Sj, Theorem III. 4.1 
and Remark III. 4. 2). 

Indeed, the existence of a primal solution ensures the finiteness of p(Q). In ( 1221) 
the function /(•) is convex, since $ is a convex set; and g(-) is convex, since the 
set C + — al is convex. The function g(-) is indeed continuous at some A<p with 
ipo G dom(/), provided A(p G int(£+ — al). If we take y? = 0, then ip G dom(/) 
since <po G $ , and we see that A(p$ = G int(£ + — al) since int(£+) 7^ in the norm 
topology and a > 0. Hence, we have strong duality. 

• The existence of a solution to the primal problem p(Q) (that is, of a generalized test 
tpQ G $ Q that attains the supremum in (1151) ) follows from the weak* compactness of $ a . 
With strong duality established, the existence of a solution to the dual problem, that is, 
of an element Xq G A + that attains the infimum in (fT6l) . follows (Ekeland & Temam [8], 
loc. cit.); whereas the values of the primal (respectively, the dual) objective functions 
at (f>Q (respectively, Xq) coincide. To indicate the dependence of these quantities on 
the selected Q G Q, we have used the notation <J5q and Xq for the primal and dual 
solutions, respectively. 

These considerations lead to a necessary and sufficient condition for optimality. 
Indeed, let us write the expression for E Q [(/?] that appears in the equation of ((7|), as 



e«m = E>T+ Q ] - E R [ V TI Q } + E R L I z 



jpdX 

'3p 



in the notation of (|28|) . and subtract it from the dual objective function E^fT^g] + 
QtA(3p) as in (|2U|) . Because of strong duality, this difference has to be zero when 
evaluated at ((p, X) — ((fQ, Xq) , namely: 



E 



l T± q Q (1 - <p Q )] +E R [rz^ Q £ Q } + J (a-E R [Z P ^Q})dX Q = 0. 



3p 
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Each of these three integrals is nonnegative, so their sum is zero if and only if (fg G $ Q 
satisfies the condition (j!8p of Lemma 14.41 and is of the form (|T7|) or, equivalently, of 
the form <£q = 9?^ _q of ( 1271) . □ 

Now, we are able to prove our main result. 

Proof of Theorem \4-2\ With Lemma 14.41 it follows that 

min(maxE Q M) = min p(Q) = min d(Q) = min V(Q,X) = V* 

QeQV^a J QaQ QeS (Q,A)eQxA + 

in the notation of (jHJ) and (IT^|) . ffTBj) . From Lemma [4.31 it follows that there exists an 
element Q of Q which attains the infimum in ( fTPl) . For this Q , Lemma 14.41 shows 
the existence of an element A^ of A + that attains the infimum in (1161) . Thus, there 

exists a pair (Q, A) that attains the infimum in (jSJ), and Lemma [4.41 gives the required 
structural result. □ 

Corollary: It follows that the optimal randomized test has the form 

= W^W^^-W^W"' (30) 

reminiscent of (TJP, where the random variable 8 : f2 — > [0, 1] is chosen so that / fi^j) zs 
satisfied by <p . 



5 Extensions and Ramifications 

Remark 5.1. The weak compactness of the set of alternative densities 3q in Assump- 
tion IllHi) seems to be crucial. Without it, we can still get 

max ( inf E Q \ip] | = inf ( maxE* 9 ^! ) 
\Qe<2 J QeQ \<p€$ a J 

by Fenchel duality (endowing L°° with the norm topology). There is no guarantee 
anymore, however, that the infimum will be attained in Q. The infimum will be 
attained at some element ju of the set Wl C {/i G ba(fi,jF) + | ju(fi) = 1}, which 
contains Q ; but since a Hahn decomposition might not exist for this ju , we do not 
obtain in general the 0-1 structure in flHUj) of the primal solution with respect to the 
dual solution. 

It seems reasonable to endow L°° with the weak* topology, and to apply Fenchel 
duality. But then it is tricky to show that a suitable constraint qualification (e.g., that 
p(ip) = supg g gE Q [y9] be weakly* continuous at some <p G $ a ) is satisfied, which is 
needed to obtain strong duality. 

Assuming 3 q to be weakly compact and convex, as we have done throughout the 
present work, has enabled us to apply a min-max theorem and to ensure that the 
infimum in the dual problem is attained within 3q Q E 1 . 
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• If we were to drop the compactness Assumption I4.1( ii) on the set of densities 3p , 
then the norm-dual of £ would be ba(3v,B) instead of A (recall the definitions of 
the spaces £ and A from the start of the proof of Lemma 14.4ft . The elements of 
the space ba^-p, B) are the ultimate generalized Bayesian priors; they are allowed 
to assign negative weights to sets of possible scenarios, and to be just finitely (as 
opposed to countably) additive. But in such a setting, Tonelli's Theorem cannot be 
applied anymore. It is possible to endow £ with the Mackey topology, to ensure A 
is the topological dual space of £ ; but proving strong duality under this topology is 
a challenge. Throughout this paper Assumption I4.1( ii) is imposed to ensure that the 
norm-dual of the space £ is A , and that a strong duality result can be obtained. 

Remark 5.2. The results in this paper can be extended in several directions. For 
instance, our proofs have not used the assumption that V and Q are families of 
probability measures. The results still hold if we consider instead two arbitrary subsets 
of L 1 , namely Q (in lieu of 3-p) and Ti (in lieu of 3q), that satisfy Assumption 14.11 
as well as sup Ggg ||G|| L i < oo . 

Furthermore, instead of a constant a G (0, 1), we may consider a positive continuous 
functional a : Q —>■ 1R + . The corresponding optimization problem is then 

sup ( inf E&H}) , (31) 

subject to 

E R [cpG] < a{G), V G EG. (32) 

The problem fl31l) - fl32l) is no longer of Hypothesis- Testing form in the classical sense, 
but its structure is similar to that of testing composite hypotheses. Such so-called "gen- 
eralized hypothesis-testing problems" arise also in the context of hedging contingent 
claims in incomplete or constrained markets, for instance when one tries to minimize 
the expected hedging-loss (see Cvitanic Rudloff [T5] or, in a related context, Schied 

MY 

This kind of generalized hypothesis testing problem was studied for the case of a 
simple alternative (i.e., Ti being a singleton), and a positive, bounded and measurable 
function a(-), by Witting [18] . Section 2.5.1. For this case it was shown with Lagrange 
duality that the generalized 0-1 structure ( J30l of a test is sufficient for optimality. 
Furthermore, it was shown in [18] that, for a finite set Q , the conditions ( JT71) . (|T8l) 
are necessary and sufficient for optimality. The proof of Lemma 14.41 shows that a 
generalization of these results is possible even when both the 'hypothesis' set Q and 
the 'alternative hypothesis' set Ti are infinite, provided they satisfy the above conditions 
(Assumption 14.11 and sup Ge g ||G|| L i < oo), and a(-) is a given positive, continuous 
function. 

Related results are obtained in Lehmann [12], in Krafft & Witting [TT] which is 
apparently the first work to introduce ideas of Convex Duality in the the theory of Hy- 
pothesis Testing, and in Baumann [I], Huber & Strassen [TU], Osterreicher [H], Vajda 
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[T7] . pp. 361-362 and Schied [TB]- Lehmann [12] works with a finite set 3g , provides 
existence results and shows that the composite testing problem can be reduced to one 
with simple hypotheses (consisting of the optimal mixed strategy). Krafft & Witting 
[TT] and Witting [18] use Lagrange duality and show that, even without any compact- 
ness assumptions on the sets 3p and 3g , the generalized 0-1 structure (1301 of (p 
is sufficient for optimality, as well as necessary and sufficient if a dual solution exists 
(e.g. when 3p and 3q are finite). In this paper we showed that, under Assump- 
tion HH1 the generalized 0-1 structure of flHUl) is necessary and sufficient for optimality, 
due to strong duality with respect to the Fenchel dual problem; then, the existence of 
a dual solution follows from strong duality. Baumann [I] establishes the existence of 
a max-min optimal test using duality results from linear programming and weak com- 
pactness arguments. The problem is also studied for densities that are contents and 
not necessarily measures. Huber & Strassen [TOJ dispense with the assumption that all 
measures in 3-p and 3q be absolutely continuous with respect to a reference measure 
R , at the expense of assuming that these two sets can be described in terms of "alter- 
nating capacities" in the sense of Choquet. Finally, using totally different methods and 
motivated by optimal investment problems in mathematical finance, Schied [TBJ studies 
variational problems of Neyman-Pearson type for convex risk measures and for law- 
invariant robust utility functionals, and obtains explicit solutions for quantile-based 
coherent risk measures that satisfy the Huber-Strassen-Choquet alternating capacity 
conditions. 



6 Comparisons and Conclusion 

The problem of testing a composite null hypothesis against a simple alternative hy- 
pothesis has a long history; it has been considered in a variety of papers as discussed 
above, and in several books (for instance, Ferguson |9J, Witting [IS], Lehmann [T3] 
and Vajda [LT]). The problem of testing a composite hypothesis against a composite 
alternative has also been studied; see, for instance, Cvitanic & Karatzas [6] and the 
references therein, for one of the most recent works on this subject. We want to give 
here a short overview regarding the similarities and differences between the results in 
Cvitanic & Karatzas [BJ and Theorem 14. 21 of the present paper, both in terms of results 
and of the methods used to obtain them. 

Cvitanic & Karatzas [6] introduce the enlargement 

W := {W \ E R [<pW} <a, Vy> G $ Q } D co (3p) (33) 

of the convex hull of the Radon-Nikodym densities of V. This 'enlarged' set W is 
convex, bounded in L , and closed under R— a.e. convergence. Furthermore, it is 
assumed in Cvitanic & Karatzas [BJ that the set of densities of Q is convex and closed 
under R— a.e. convergence. The starting point of Cvitanic & Karatzas [6] is the 
observation 

VQeS,V^6W,Vo0,V V G$ a : E Q [ip] < E R [(Z Q -zW) + ]+az. (34) 
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The existence of a quadruple (Q, W, z, (p) G Q x W x (0, oo) x $ Q which satisfies ( 13~4"|) 
as equality is then shown, and the structure of 

tp(u) = 1 r ~ x (w) + <J(o;) • 1 r - 1 H ( 35 ) 

for the optimal randomized test <p is deduced. Here the triple (Q, W, z ) is a solution 
of the optimization problem 

inf (az + E R [(Z Q -zW)+]), (36) 

(Q,W) 6 QxW 

and the random variable 5 : ft — > [0, 1] is chosen so that E^[£>] = a is satisfied. 

The methodology of the present paper obviates the need to introduce the enlargement 
set W of 15*5]) . Thus, we provide a result about the structure of the solution ip in 
terms of the original families of probability measures V and Q ; we do need, however, 
the set 3q to be weakly compact. 

• Let us study the relationship between Theorem 14.21 and the results of Cvitanic & 
Karatzas [6]. With the help of Tonelli's Theorem it is easy to show that we have 

k I Z P d\ G W , V A G A+ , 
hv 

where k = (A(3p)) _1 if A(3-p) > and k = if A(3-p) = 0. The case A(3-p) = implies 
X(B) = for all B G £>, and thus ZpdX = 0. If we consider in ( 1341) only elements W 
of the form k Z P dX G W , then the inequality (IH41) coincides with the weak duality 
between the primal and dual objective functions p(Q) and T>(Q), and reduces to the 
inequality in (J7J); whereas Problem ( 136]) reduces to (jHJ). 

To summarize the methodology: Cvitanic & Karatzas [B] proved the existence of a 
primal and a dual solution that satisfy ( J34l) as an equality; in order to do this, strong 
closure assumptions had to be imposed. In the methodology of the present paper, the 
validity of strong duality, hence also the equality in (JTj), are shown directly via Fenchel 
duality; then the existence of a dual solution follows. 

Both methods lead to a result about the structure of an optimal test. But now 
it is possible to show the impact of the original family V on the sets that define the 
solution (p in [6], as in ( 1351) : 

z W = [ ZpdX, (37) 
where (Q, A) is the optimal pair, that attains the infimum in (jHJ). This means 

z = A(3p) and W = k J ZpdX, (38) 

where k = (A(3p)) _1 if A(3t>) > , and k = if A(3t>) = . 
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Let us highlight the improvements made possible by the methodology of the present 
paper. With Theorem 14.21 one can provide a result about the structure of the solution 
lp in terms of the original sets V and Q ; it is not necessary to embed 3p into the 
larger set W of (1331) . But instead of assuming that 3q = {Zq \ Q G Q} is closed under 
R—a.e. convergence, we need here to assume that this set is weakly compact in L 1 . 
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